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(54) Analog delay line for image processing 

(57) The present invention is directed to an analog 
delay line for a color CMOS image sensor which is com- 
patible with MOS fabrication technology. The invention 
allows for the simultaneous reading of pixel signals from 
two rows of pixels so that combinations of signals from 
pixels in different rows may be obtained. The delay line 
includes a set of storage capacitors on which the pixel 
signals are stored, and a means for writing the signals 
from the pixels onto the capacitors In sequence. The 
stored analog pixel signals may then be read out from 
the delay line at the appropriate time so that they may 
be combined with pixel signals from adjacent pixels in 
different rows. In one embodiment, two delay lines are 
used, so that pixel signals from a current row can be 
written into one delay line, while the pixel signals from a 
previous row are being read out from the other delay 
line. In another embodiment, a single delay line is used 
in combination with a single pixel delay circuit. When the 
single pixel delay circuit is used, the pixel signals from a 
previous row are read out from the delay line and tem- 
porarily stored in the single pixel delay circuit, one at a 
time, shortly after which the pixel signals from the next 
row are written into the delay line. The pixel signals from 
the single pixel delay circuit are then read out at the 
same time that the pixel signals from the next row are 
being read in, so that signals from adjacent pixels in 
adjacent rows are available to the processing circuitry at 
the same time. 
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Description 

Figid Qf the Inven tio n 

[0001] The present invention relates to metal oxide 
semiconductor (MOS) image sensors and, more partic- 
ularly, an analog delay line for a MOS Image sensor. 

PacKgrPund of the Invention 

[0002] Integrated circuit technology has revolution- 
ized various fields including computers, control sys- 
tems, telecommunications, and imaging. In the field of 
imaging, the charge coupled device (CCD) sensor has 
made possible the manufacture of relatively low-cost 
and small hand-held video cameras. Nevertheless, the 
solid-state CCD integrated circuits needed for imaging 
are relatively difficult to manufacture, and therefore are 
expensive. In addition, because of the differing proc- 
esses involved in the manufacture of CCD integrated 
circuits relative to MOS integrated circuits, the signal 
processing portion of the Imaging sensor has typically 
been located on a separate integrated chip. Thus, a 
CCD imaging device includes at least two integrated cir- 
cuits: one for the CCD sensor and one for the signal 
processing logic. 

[0003] Some of the further drawbacks of CCD tech- 
nology are discussed in "Active Pixel Sensors - Are 
CCD's Dinosaurs?" by E.R. Fossum, Proceedings of the 
SPIE - The Intennationat Society for Optical Engineer- 
ing, Vol. 1900, 1993. pp. 2-14. As stated therein, 
"[allthough CCDs have become a technology of choice 
for present-day implementation of imaging and spectro- 
scopic instruments due to their high-sensitivity, high 
quantum efficiency, and large format, it is well-known 
that they are a particularly difficult technology to master. 
The need for near-perfect charge transfer efficiency 
makes CCDs (1) radiation 'soft,* (2) difficult to reproduc- 
ibly manufacture in large anray sizes, (3) incompatible 
with the on-chip electronics integration requirements of 
miniature instruments, (4) difficult to extend the spectral 
responsivity range through the use of alternative mate- 
rials, and (5) limited in their readout rate." 
[0004] An alternative low-cost technology to CCD 
integrated circuits is the metal oxide semiconductor 
(MOS), integrated circuit. Not only are imaging devices 
using MOS technology less expensive to manufacture 
relative to CCD Imaging devices, for certain applications 
MOS devices are superior in performance. For example, 
the pixel elements in a MOS device can be made 
smaller and therefore provide a higher resolution than 
CCD image sensors. 

[0005] Examples of MOS imaging devices are 
detailed in "A l^ Inch Format 250K Pixel Amplified MOS 
Image Sensor Using CMOS Process" by Kawashima et 
al., lEDM 93-575 (1993), and "A Low Noise Line-Ampli- 
fied MOS Imaging Devices" by Ozaki et al., IEEE Trans- 
actions on Electron Devices, Vol. 38, No. 5, May 1991. 
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In addition. U.S. Patent No. 5.345,266 to Denyer. titled 
"Matrix Array Image Sensor Chip," describes a MOS 
image sensor. The devices disclosed in these publica- 
tions provide a general design approach to MOS imag- 
5 ing devices. In addition. MOS approaches to color 
imaging devices are described In "Color Filters and 
Processing Alternatives for One-Chip Cameras," by 
Parulski. IEEE Transactions on Electron Devices, Vol. 
ED-32. No. 8, August 1985, and "Single-Chip Color 
io Cameras With Reduced Aliasing" by Imaide et al., Jour- 
nal of Imaging Technology, Vol. 12, No. 5, Oct. 1986, pp. 
258-260. 

[0006] In the movement from CCD- to MOS-based 
implementations that can be fabricated on a single MOS 
15 chip, certain concepts from the CCD technology have 
not transferred smoothly One example is related to the 
external CCD-delay line that Is still used In many image 
processors to obtain the necessary signals from two 
rows of pixels simultaneously. The need to process two 
20 rows of pixels simultaneously is related to the process- 
ing of signals from complementary color filter patterns, 
as Is described in more detail below. 
[0007] In most solid-state color Image sensors, a 
complementary color filter pattern is used. Arrays of pix- 
25 els may be made to detect color by being covered with 
a regular pattern of color filter patches, known as a color 
filter pattern. The filter patches can be fabricated 
directly on the sensor or on a transparent substrate 
which is later cemented to the chip. Color filter patterns 
30 may include colors such as red (R), green (G), blue (B), 
yellow (Ye), cyan (Cy) and magenta (Mg). The pixels 
beneath the color filter pattern emit signals when they 
are exposed to the type of light indicated by the color fil- 
ter patch. Thus, a red signal could be obtained from a 
35 pixel beneath a red filter patch, a blue signal could come 
from a pixel beneath a blue filter patch, and so on. 
[0008] However, some image sensors do not obtain 
the standard red, green and blue signals from red, 
green and blue filtered pixels. Instead, they use combi- 
40 nations of other colors to obtain the standard ones. For 
example, red (R) can be formed according to the equa- 
tion R= (W+Ye) - (G+Cy) , where the color filter pixel 
signals are W = white. Ye = yellow, G= green, and Cy = 
cyan. In cases such as this, the four pixel signals being 
45 processed are obtained from a 2x2 block of one of each 
type of pixel sensor, rather than a 1 x4 row of pixel sen- 
sors which would tend to distort the color image. The 
2x2 block presents a problem for standard pixel scan- 
ning methods because standard methods scan each 
50 row, one at a time. In contrast, the 2x2 block of pixels 
comes firom sections of two separate rows. Thus, the 
system cannot process the data as It scans each row. It 
must wait until the next row Is also scanned to obtain the 
remaining information that it needs, and it must some- 
55 how save the data from the previous row until it does so. 
[0009] Just as the color signals in such cases can 
be a combination of the signals from a 2x2 pixel block, 
the chrominance signal, which correlates to the color of 
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the image, is also sometimes obtained from a combina- 
tion of signals from pixels in two separate rows. In fact, 
this is the case for the chrominance signal in many sys- 
tems, even those in which R, G and 6 filters are used to 
obtain the color signals directly. Therefore, it is required 5 
In such systems to somehow have the data from two 
separate rows available at the same time so that the 
required combinations can be processed. 
[0010] A standard method for making the data from 
two separate rows available at the same time is to use a 10 
delay line. The delay line holds the data from one row 
until the next row can be scanned to provide the needed 
infbnmation. One simple type of delay line is a digital 
delay line. The digital delay line stores digital values 
representative of the pixel signals from a given row. Dig- is 
ital delay lines are commonly used in MOS imaging 
devices. However, in order to use a digital delay line, the 
pixel signals must necessarily be first converted to dig- 
ital values before they are stored in the digital delay line. 
One of the problems with converting the pixel signals to 20 
digital values at this early stage, is that the analog-to- 
digital processing requires a significant amount of 
power. This is an undesirable characteristic in certain 
implementations of imaging devices. 
[001 1] An alternative to a digital delay line that has 25 
been used in most prior art CCD devices is an analog 
CCD delay line. FIGURE 1 illustrates a general CCD 
delay line of the prior art. As illustrated in FIGURE 1. 
signals from a sensor an^y are received via a signal line 
VO by a CCD delay line 10. The CCD delay line 10 30 
delays the pixel signals as it takes time for the signals to 
cascade down the cells of the CCD delay line. The CCD 
delay line is controlled so that after a first row of pixels 
has been read into the CCD delay line, the signal from 
the first pixel of the first row is read out from the CCD 35 
delay line on the signal line VI at the same time that the 
pixel signal from the first pixel of the second row is being 
received on the signal line VO. In this manner, the signal 
processing circuitry 12 receives the signals from adja- 
cent pixels in two different rows at the same time. In this 40 
manner, a 2X2 pixel block may be obtained fbr signal 
processing, as described above. 
[0012] In the movement from CCD- to MOS-based 
implementations, methods of implementing the circuitry 
have been sought that can easily be fabricated on a sin- 45 
gle MOS chip. The approach of using an external CCD 
delay line device in the color image sensors, which was 
earned over from the old CCD technology, has inher- 
ently required the use of CCD components that are 
external to the circuit and that are sometimes required so 
to be on a separate chip, in addition to increasing the 
relative complexity of the Implementation. It is a general 
principle that power consumption and cost would 
decrease if the number of chips and complex compo- 
nents necessary to accomplish the task were ss 
decreased. The present invention is directed toward an 
improved analog delay line that can be fabricated using 
MOS technology, and which can therefor be integrated 
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on a single-chip with the MOS sensor array. 



Summary of the Invention 

[0013] The present invention is directed to an ana- 
log delay line fbr a MOS image sensor which allows the 
simultaneous reading of pixel signals from two adjacent 
rows of pixels so that combinations of signals from pix- 
els in adjacent rows may be obtained. The delay line 
includes a set of storage capacitors, a first set of 
switches for selectively placing signals from a row of the 
pixel array on the first set of storage capacitors, and a 
second set of switches for selectively reading out the 
signals from the storage capacitors. In one embodiment 
of the invention, two delay lines are utilized, such that 
the signals from one row of the pixel array can be being 
stored in one of the delay lines, while the signals from 
the previous row of pixels that were previously stored in 
the other delay line can be being read out. in another 
embodiment of the invention, a single delay line is used, 
in combination with a single pixel delay circuit. In the 
second embodiment, the signals that were previously 
stored in the delay line from the previous row are read 
out one at a time into the single pixel delay circuit, just 
ahead of when the new signals from the pixels of the 
next row are being read into the delay line. In this man- 
ner, the pixel signals from the single pixel delay circuit 
can be being output at the same time that the pixel sig- 
nals from the next row are both being stored in the delay 
line, and are available fbr signal processing. Thus, sig- 
nals from adjacent pixels in adjacent rows can be being 
read out simultaneously, as is the goal of the invention. 
[0014] The single pixel delay circuit includes a set of 
two storage capacitors, a set of two input switches for 
selectively placing pixel signals on the two storage 
capacitors, and a set of two output switches for selec- 
tively reading out the pixel signals that were previously 
stored on the two storage capacitors. Various amplifiers 
and buffers are used in combination with the delay line 
and single pixel delay circuit structures, so as to effec- 
tively transfer the pixel signal charges. The capacitors, 
MOS switches, buffers, and amplifiers of the reading 
structure are easily ^bricated as part of a MOS image 
sensor on a single chip. 

Brief Description of the Drawings 

[0015] The foregoing aspects and many of the 
attendant advantages of this Invention will become 
more readily appreciated as the same becomes better 
understood by reference to the following detailed 
description, when taken in conjunction with the accom- 
panying drawings, wherein: 

FIGURE 1 is a block diagram of a prior art CCD 
delay line; 

FIGURE 2 is a block diagram of a single-chip 
CMOS imaging sensor with an analog delay line 
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formed in accordance with the present invention; 
FIGURE 3 Is a schematic diagram of a six-column, 
four-row pixel array; 

FIGURE 4 is a block diagram of a sensor reading 

structure utilizing two analog delay lines formed in 5 

accordance with the present invention; 

FIGURE 5 IS a schematic diagram of an analog 

delay line formed in accordance with the present 

invention; 

FIGURES 6-8 illustrate various embodiments of the io 
buffer and amplifier components of FIGURE 5; 
FIGURE 9 is a timing diagram illustrating the oper- 
ation of the reading structure of FIGURE 4; 
FIGURE 10 is a reading structure utilizing a single 
delay tine and single pixel delay circuit formed in is 
accordance with the present invention; 
FIGURE 1 1 is a schematic diagram of a single pixel 
delay circuit of FIGURE 10; and 
FIGURE 12 is a timing diagram illustrating the oper- 
ation of the reading structure of FIGURE 10. 20 

Petgiled Pescriptton Pf the Pretended Embodiment 

[0016] With reference to FIGURE 2. a block dia- 
gram of a single-chip CMOS imaging sensor includes 25 
an image sensor array 101. The retrieval of information 
from the image sensor array is done by the peripheral 
circuitry of FIGURE 2 and the output is done in accord- 
ance with the well-known NTSC scheme. This scheme 
allows the output signals from the circuit to be transmit- 30 
ted and displayed by conventional means. 
[0017] The signals from the sensor array 101 are 
processed by a sensor reading structure 201, which is 
formed in accordance with the present invention. As will 
be later explained, this novel reading structure allows 35 
the reading of two line signals from two separate rows of 
pixels simultaneously, through the use of an analog 
non-CCD-type delay line device. The sensor reading 
structure 201 outputs line signals SIG1 and SIG2, which 
are amplified by signal amplifiers 305. In one actual 40 
embodiment, the signal amplifiers 305 are formed in 
accordance with U.S. Patent No. 5,724,095 entitled 
•'IMPROVED CHARGE AMPLIFIER FOR MOS IMAG- 
ING ARRAY AND METHOD OF MAKING SAME." to 
Shyu et al., and U.S. Patent No. 5,751,189 entitled 45 
"IMPROVED CHARGE AMPLIFIER FOR MOS IMAG- 
ING ARRAY AND METHOD OF MAKING SAME," to 
Shyu et al., both of which are incorporated herein by ref- 
erence. 

[0018] Amplified line signals SIGV and SIG2' from so 
the signal amplifiers 305 are then processed by proces- 
sor 307 which performs automatic gain control amplifi- 
cation and black level calibration. Processed line signals 
SIGI" and SIG2" from processor 307 go to the color 
matrix 309. The color matrix 309 combines the line sig- ss 
nals in various proportions according to matrix equa- 
tions and also performs gamma correction so as to 
derive the output color signals, such as green (G*), red 
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(R'), blue (B*). or the luminance signal (Y"). The "prime" 
indicates the signal has undergone gamma correction. 
The red (R') and blue (B') output color signals may be 
obtained as a function of the difference between two line 
signals. The luminance signal (Y*) is formed from a lin- 
ear matrix function by which the other signals are com- 
bined in various proportions. As described previously, 
some of these functions require the use of the delay line 
for the signal processing. The processor 311. which 
performs the luminance signal process, takes the signal 
Y* from the color matrix 309 and outputs the signal YH 
along with a feedback signal which goes to the AEC 
detector 31 7. The YH signal is the luminance signal with 
high frequency components. 

[0019] The color signals G', R', and B' go from the 
color matrix 309 to the processor 313, which pet-forms 
the chromaticity signal process, where they are proc- 
essed so as to produce the signals -(R-Y) and -(B-Y), 
from which the chroma signal is formed. The chroma 
signal is formed by quadrature modulating the two color 
difference signals, (R-Y) and (B-Y), on a color subcar- 
rier. In alternate systems, I (in phase) and Q (quadra- 
ture) color difference signals are sometimes used rather 
than (R-Y) and (B-Y), although the latter are what are 
most often used in consumer cameras. The phase and 
amplitude of the chroma signal indicate hue and satura- 
tion. 

[0020] The NTSC encoder 315 receives control tim- 
ing signals SYNC and BLANK from a video timing gen- 
erator 319, and also receives control signals FSC, HUE, 
and SATURATION. The YH signal from the luminance 
signal process 31 1 , and the color difference signals -(R- 
Y) and -(B-Y) from the chromaticity signal process 313, 
go to the NTSC encoder 315 where they are processed 
to produce the output signals CVBS (composite video 
with blank and sync) and the Y+C combined signal. The 
baseband luminance signal (Y) correlates to the bright- 
ness of the image, and the quadrature-modulated 
chrominance signal (C) correlates to the color of the 
image. 

[0021] The processor 31 1 , which performs the lumi- 
nance signal process, outputs a feedback signal to the 
AEC detector 317, which outputs a control signal to the 
controller 321 which performs the AEC & AGC control. 
As is known in the art, AEC refers to automatic expo- 
sure control. The video timing generator 319 outputs 
timing signals SAMPLE and PRECHARGE which go to 
the sample and precharge areas of the an^y row con- 
troller 151, respectively, for purposes of controlling the 
scanning of the image sensor array 101 . The array row 
controller 151 also includes a row driver section. The 
video timing generator 319 also outputs a timing signal 
to the controller 321 which performs the AEC & AGC 
control. The controller 321 outputs control signals to the 
sample timing counter 323 and to the precharge timing 
counter 325. The sample timing counter 323 and the 
precharge timing counter 325 are connected to the 
sample and precharge areas of the array row controller 



4 



EP 1 085 522 A1 



151, respectively. The image sensor array 101 is con- 
trolled by the array row controller 151, the row calibra- 
tion cells 153, and the column calibration cells 155. 
[0022] As noted above, it is desirable that the sen- 
sor reading structure 201 be able to read two line sig- 5 
nals from two separate rows in such a way that the 
needed portions of data from both rows is available to 
be processed at the appropriate time. Prior art devices 
have used digital or CCD delay lines for this purpose. As 
described previously, one of the problems with the dig- io 
ital delay line is the high power usage required for the 
analog to digital conversion. One of the problems with 
the CCD delay line is that it is necessarily external to the 
MOS imaging sensor, which can add to the number of 
chips and the complexity of the implementation. Thus, is 
there is a need for a structure that can be easily fabri- 
cated on the same chip as the MOS sensor array and 
that can make available the needed signals from two 
separate rows of pixels during a specified processing 
interval. 20 
[0023] Turning now to FIGURE 3. a pixel sensor 
anBy 101 that is read by the reading structure of the 
present invention is shown. The pixel sensor an^y 101 
includes six columns of four rows of pixels 103. As 
shown, each pixel in each block of four pixels in FIG- 25 
URE 3 is designated as having one of four colors, 
CLR1, CLR2. CLR3, or CLR4. In one embodiment the 
colors CLR1 and CLR4 would be the same (green). 
[0024] In the embodiment illustrated in FIGURE 3. 
the first column of pixels has pixels 103A to 103D, the 30 
second column has pixels 103E to 103H, and so on until 
. the sixth column, which has pixels 103U to 103X. Each 
row of pixels is controlled by a pixel control signal P1, 
P2, P3, or P4. All of the pixels in the first row, including 
pixels 103A, 103E. 1031, 103M, 103Q. and 103U, are 35 
controlled by pixel control signal P1. The pixels in the 
second, third, and fourth rows are similarly controlled by 
pixel control signals P2, P3, and P4, respectively. 
[0025] Six column amplifiers 105, one for each col- 
umn of pixels in FIGURE 3 are shown. Each column 40 
amplifier Is controlled a column select signal Y1 to Y6. 
Thus, the first column amplifier is controlled by column 
select signal Y1, the second column amplifier 105 Is 
controlled by column select signal Y2, and so on until 
the sixth column amplifier which is controlled by the col- 45 
umn select signal Y6. The outputs of all six column 
amplifiers are coupled together at a signal line SIG1. 
Signal line SIG1 continues to a point "A", that will be fur- 
ther illustrated with respect to FIGURE 4. 
[0026] FIGURE 4 illustrates a reading structure so 
201 A formed in accordance with the present invention. 
As shown, reading structure 201 A includes two delay 
lines 211 and 212 formed in accordance with the 
present invention. This structure illustrates the method 
by which the present invention may read two line signals ss 
from two rows of pixels simultaneously and thus provide 
the needed portions of data from the two rows during 
the specified processing interval. 



■ated in F 



[0027] As illustrateFin FIGURE 4, from point "A" 
signal line SIG1 is coupled to write switches W1 and 
W2. Write switch W1 couples signal line SIG1 to an 
input of delay line 211. The output of delay line 211 is 
coupled by a read switch R1 to an input of a buffer 220. 
[0028] Signal line SIG1 is also coupled by a write 
switch W2 to an input of delay line 212. The output of 
delay line 212 is coupled by a read switch R2 to the 
input of buffer 220. The output of buffer 220 Is coupled 
to a signal line SIG2. The two output signals from the 
reading structure 201A are therefore signal lines SIG1 
and SIG2. 

[0029] As will be described in more detail below, the 
purpose of the reading structure 201 A of FIGURE 4 is to 
provide a delayed output of a row of pixel signals, so 
that the signals from the row of pixels that is currently 
being read out can be processed simultaneously with 
the pixels from the previous row. Thus, signal line S1G1 
carries signals from the cun^ent row of pixels, whereas 
signal line SIG2 carries delayed signals from the previ- 
ous row of pixels. The two delay lines 211 and 212 are 
used so that one delay line may be storing the pixel sig- 
nals from the current row, while the other delay line Is 
reading out the stored pixel signals from the previous 
row. The overall operation of the reading structure 201 A 
of FIGURE 4 will be described in more detail below with 
respect to the timing diagrams of FIGURE 9. 
[0030] FIGURE 5 shows a schematic implementa- 
tion of the delay line 21 1 of FIGURE 4. Delay line 212 is 
similar to delay line 211. with the exception that the 
switches and capacitors of delay line 212 are given dif- 
ferent designations, as will be described in more detail 
below. As illustrated in FIGURE 5, the Input to the delay 
line 211 is coupled by a component 214 to a series of 
six switches W1A to W1R Each of the six switches W1A 
to W1 F couples to one side of one of six capacitors CIA 
to C1F, respectively The other sides of the capacitors 
C1A to C1F are coupled to ground. The six capacitors 
CI A to CI F are coupled through six components 21 6 to 
a series of six switches R1A to R1F, respectively Each 
of the six switches R1 A to R1F couples each of the six 
capacitors CIA to C1F, respectively, to a component 
218. The output of component 218 Is the output of the 
delay line 211. 

[0031] FIGURES 6A and 6B illustrate an embodi- 
ment of component 214 of FIGURE 5. As illustrated in 
FIGURE 6A. component 214 may include a buffer 215 
with an input and an output. As illustrated in FIGURE 
6B, buffer 215 may comprise a MOS switch M14. As 
illustrated in FIGURE 6B, the source of MOS switch 
M14 is coupled to the power supply VDD, while the gate 
is coupled to the input of the buffer 215, and the drain 
provides the output. 

[0032] FIGURES 7A to 7C illustrate various embod- 
iments of component 216. As illustrated in FIGURE 7A, 
in one embodiment, the component 216a comprises a 
simple conductor wire 217a. In the embodiment of FIG- 
URE 7A, the component 216 is merely a continuation of 
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the conductor that couples the capacitors C1 to the 
switches R1. As illustrated in FIGURE 7B, in another 
embodiment, the component 216b includes a buffer 
217b. Buffer 217b may be similar to the buffer 215 
described previously with respect to FIGURES 6A and 
68. FIGURE 7C illustrates another embodiment of the 
component 216. As illustrated in FIGURE 7C, the com- 
ponent 216c includes a buffer 217c In which the offset 
may be adjusted by a control signal V^s. The input of the 
huffier 217c is coupled to a reference voltage V^ef by a 
reset switch RST1. 

[0033] FIGURES 8A to 8C Illustrate various embod- 
iments of component 218 of FIGURE 5. As illustrated in 
FIGURE 8A. In one embodiment, a component 218a 
includes an operational amplifier 219a. Operational 
amplifier 219a has its inverting input coupled by a feed- 
back capacitor C18 to its output. An eqalizing switch EQ 
also couples the noninverting input of operational ampli- 
fier 219a to Its output. The noninverting input of opera- 
tional amplifier 219a is coupled to a reference voltage 
Vref. As illustrated in FIGURE 88, in another embodi- 
ment, a component 218b Includes a buffer 219b. As 
illustrated in FIGURE 8C, in another embodiment, a 
component 21 8c includes an operational amplifier 21 9c. 
The input of the component 218c is coupled by a capac- 
itor CI 9 to the inverting input of the operational amplifier 
219c. The noninverting input of the operational amplifier 
219c is coupled to a reference voltage V^ef. The invert- 
ing input of the operational amplifier 219c is coupled by 
a capacitor C20 to the output of the operational amplifier 
219c. An equalizing switch EQ Is also coupled between 
the inverting input of the operational amplifier 219c and 
the output. 

[0034] Depending on the types of pixels used and 
the desired pixel signal processing, the various embod- 
iments for the components 216 and 218 illustrated In 
FIGURES 7 and 8 may be used. In one implementation, 
the embodiments of FIGURES 7A and 8A are used 
together, while in another implementation the embodi- 
ments of FIGURES 78 and 88 are used together, and 
while in still another implementation, the embodiments 
of FIGURES 7C and 8C are used together. In general, 
when the pixels 103 are passive pixels, the components 
are more likely to be directed toward charge amplifiers, 
whereas if the pixels 103 are active pixels, the compo- 
nents are more likely to be voltage buffers or voltage 
amplifiers, or to be simple conductors as illustrated in 
the embodiment of FIGURE 7A. 
[0035] With regard to the various embodiments 
illustrated in FIGURES 7 and 8, there are certain advan- 
tages to each configuration. For example, in the embod- 
iments illustrated by FIGURES 78 and 88, there is 
shown to be an amplifier for each storage cell capacitor 
of the delay line 211. This configuration effectively 
addresses the relatively large parasitic capacitance that 
exists in the delay line 211 at the component 218. In 
other words, because all of the switches of the delay line 
21 1 are coupled to the same points, relatively large par- 



asitic capacitances exist. This relatively large parasitic 
capacitance can cause the system to operate more 
slowly. 8y including amplifiers for each storage cell 
capacitor, the amplifiers are able to drive the voltages 

5 over the parasitic capacitances very quickly Thus, the 
overall speed of the system can be increased. 
[0036] With regard to the embodiments of FIG- 
URES 7A and 8A, one of the advantages of this config- 
uration is the relatively simple layout that requires fiewer 

10 components and connections. Thus, a smaller, less 
expensive circuit results. In addition, there are no con- 
cerns with regard to the mismatches that can occur 
when multiple amplifiers are used for each capacitor. 
[0037] The embodiments of FIGURES 7C and 8C 

15 help address the concern of mismatches between mul- 
tiple amplifiers. For example, if there are 640 pixels in a 
row. 640 amplifiers and components would be required, 
which could have as much as 10s of millivolts of mis- 
matches between them. The implementation of the 

20 embodiments of FIGURES 7C and 8C can provide for 
correlated double sampling, and a reference voltage for 
the double sampling and subtraction for noise cance- 
ling, that allows the voltage mismatch between the col- 
umns to be reduced. 

25 [0038] The operation of the reading structure 201 A 
shown in FIGURES 4 and 5 is Illustrated by the timing 
diagrams shown In FIGURE 9. In general, while the tim- 
ing diagrams of FIGURE 9 show pixel signals as being 
transferred relatively instantaneously, it is understood 

30 that the actual transfer of such signals Involves transient 
periods, due to the charging of the capacitors and simi- 
lar phenomena, which are not shown in the diagrams. In 
addition, while the signals are shown for a certain time 
period in the diagrams, it is understood that the named 

35 signals do not necessarily remain on the line signals for 
the full time period shown, and they are shown there 
only for purposes of illustration as if the charge for each 
of the capacitors have been transferred to the signal line 
SIG2. It is also understood that In an actual implemen- 

40 tation there may be spacing between the signals such 
that intermediary processes can occur, such as reset- 
ting the signal levels on the capacitors or of the amplifi- 
ers or buffers to a desired reset value. 
[0039] As shown in FIGURE 9, at the beginning of a 

45 time period 1 , the pixel control signal PI goes high at 
the same time as the column select switch Y1 of FIG- 
URE 3. the write switch W1 of FIGURE 4. and the write 
switch W1A of FIGURE 5. Thus, the pixel signal from 
pixel 103a appears on signal line SIG1 and is also 

50 stored on capacitor C1A. Similarly, in the next time 
increment during time period 1 , the column select signal 
Y2 goes high at the same time as write switch W1B, 
thus reading out the signal from pixel 103e on signal line 
S1G1 at the same time that the signal is stored on 

55 capacitor CI 8. This process continues for reading out 
the signals frotx) pixels 1031, 103m. 103q, and 103u. 
which are stored on capacitors C1C, C1D, C1E, C1F, 
respectively Once all of the pixels of the first row have 
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been read out, the control signal P1 and the write switch 
W1 at transition low, thus indicating the end of write 
operation from the first row of pixels. 
[0040] As was described previously with respect to 
FIGURE 4, delay line 212 is similar to delay line 211, 5 
except with different switch and capacitor designations. 
More specifically, while the write switches of delay line 
211 are designated as switches W1A to W1F, the write 
switches of delay fine 212 are designated as switches 
W2A to W2F. Similarly, the capacitors of delay line 212 io 
are designated as capacitors C2A to C2F, and the read 
switches are designated as switches R2A to R2R These 
designations are used in the timing diagrams of FIG* 
URE 9, as described below. 

[0041] During time period 2, the control signal P2 is 
for the second row of pixels, the control signal for write 
switch W2, and the control signal for read switch R1 all 
go high at the same time. The control signal P2 and the 
control signal for write switch W2 going high indicates 
that the second row of pixels will be written Into the 20 
delay line 212 of FIGURE 4. The control signal for read 
switch R1 going high indicates that the pixel signals 
from the first row of pixels that were stored in delay line 
211 during time period 1 , will now be read out on signal 
line S1G2. As illustrated in FIGURE 9, column select sig- 25 
nal Y1 goes high at the same time as the control signals 
for read switch R1 A and write switch W2A. Thus, during 
this first increment of time period 2, the signal from the 
first pixel 103b of the second row is read out onto signal 
line SIG1 , and Is also stored In capacitor C2A of delay 30 
line 212. At the same time, the control signal for the 
read switch R1A causes the pixel signal from pixel 103 
a that it had previously been stored on capacitor C1 A to 
be read out on signal line SIG2. In this manner, the sig- 
nals from pixel 1 03a of the first row and pixel 1 03b of the 35 
second row are read out simultaneously on signal lines 
SIG2 and S1G1, respectively, as is the goal of the sys- 
tem. 

[0042] Similariy, in the next increment during time 
period 2, the column select signal Y2 goes high the 40 
same time as the control signals for the read switch R1 B 
and the write switch W2B. The control signal for the 
write switch W2B going high causes the signal from the 
second pixel 103f of the second row to be written into 
capacitor C2B of delay line 212. At the same time, the 45 
control signal for the read switch RIB causes the signal 
from the second pixel 103e of the first row that was pre- 
viously stored on capacitor C1B to be read out onto the 
signal line SIG2. Thus, signals from the pixels 103e and 
103f from the first and second rows, respectively, are so 
placed on the signal lines SIG1 and S1G2 at the same 
time, as is the goal of the system. 
[0043] This process continues during time period 2 
thus storing signals from the remaining pixels of the 
second row, including pixels 103j, 103n, 103r, and 103v, ss 
on capacitors C2C, C2D, C2E, and C2F, respectively. 
These signals are also placed on the signal line S1G1 at 
the same time that the signals from the corresponding 
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adjacent pixels of the first row, including pixels 1031, 
103n, 103q, and 103u, are read out from the capacitors 
C1C, C1D, C1E. and GIF onto signal line SIG2. Thus, 
the signal from pixel 1031 Is read out at the same time as 
the signal from pixel 103j, followed by the reading out of 
the signals from pixels 103m and 103n, the signals from 
pixels 103q and 103r, and, finally the signals from pixels 
103u and 103v. After all of the signals from the second 
row of pixels have been read out, the control signal P2 
for the second row goes low, thus indicating the end of 
the pixel reading process during time period 2. The con- 
trol signals for the write switch W2 and the read switch 
R1 also go low at this time. 

[0044] In time period 3, the process continues with 
the reading out of the pixel signals from the third row of 
pixels 103c, 103g. 103k, 103o. 103s. and 103w. As the 
signals are read out, the signals from the corresponding 
adjacent pixels in the second row are read out from the 
capacitors C2A to C2F, of which they were previously 
stored during time period 2. In this manner, the signal 
lines S1G1 and SIG2 are shown to simultaneously con- 
tain the signals from adjacent pixels in the third and sec- 
ond rows, respectively, as is the goal of the system. At 
the end of the pixel reading process in time period 3, the 
control signal P3 goes low at the same time as the con- 
trol signals for the write switch W1 and the read switch 
R2. As Indicated to the left of the timing diagram for the 
control signal P3 in FIGURE 9, the symbols for the con- 
trol signals for write switch W1 and read switch R2 are 
shown in parentheses, as these signals follow the tran- 
sitions of the signal P3 only during time period 3. The 
signals W1 and R2 transition independently of the con- 
trol signal P3 at other times (e.g., during time period 1 
when the control signals for write switch W1 and read 
switch R2 transition with the transitions in control signal 
P1). 

[0045] During time period 4, the process continues 
with the storing of signals from the fourth row of pixels in 
the second delay line 212. while the signals from the 
third row of pixels that were previously stored in the first 
delay line 211 are read out on the signal line SIG2. In 
this manner, the signals from the fourth and third rows of 
pixels are read out simultaneously on the signal lines 
SIG1 and S1G2, respectively, as is the goal of the sys- 
tem. 

[0046] FIGURE 10 illustrates another embodiment 
of the reading structure 201 of FIGURE 2. As illustrated 
In FIGURE 10, reading structure 201 B includes a delay 
line 211 and a single pixel delay circuit 230. From a 
point "A", signal line SIG1 is coupled to the input of 
delay line 21 1 . The output of delay line 21 1 is coupled to 
the input of single pixel delay circuit 230, and the output 
of the single pixel delay circuit 230 is coupled to signal 
line S1G2. The outputs from the reading structure 201 B 
are therefore the signal lines SIG1 and SIG2. 
[0047] FIGURE 1 1 shows a schematic diagram of 
the single pixel delay circuit 230. As illustrated in FIG- 
URE 1 1 , the input of the single pixel delay circuit 230 is 



7 



13 



EP 1 085 522 A1 



coupled to a write switch W3A. The write switch W3A 
couples the input to one side of a capacitor C3A and to 
an Input of a component 232. The other side of capaci- 
tor C3A is coupled to ground. The output of component 
232 is coupled to a read switch R3A. Read switch R3A 
couples component 232 to the Input of a component 
236. The output of component 236 Is the output of the 
single pixel delay circuit 230. 

[0048] Also coupled to the Input of the single pixel 
delay circuit 230 is a write switch W4A. Write switch 
W4A couples the Input to one side of a capacitor C4A 
and also to the input of a component 234. The other 
side of capacitor C4A is coupled to ground. The output 
of component 234 is coupled to a read switch R4A. 
Read switch R4A couples the component 234 to the 
input of the component 236. 

[0049] The operation of the reading structure 201 B 
of FIGURE 10 and the single pixel delay circuit of FIG- 
URE 1 1 is illustrated in the timing diagrams of FIGURE 
12. The timing diagrams for FIGURE 12 have some sim- 
ilar components to those of FIGURE 9. As illustrated in 
FIGURE 12. during time period 1. the control signal PI 
for selecting the first row of pixels 103a to 103u goes 
high. At the same time, the column select signal Y1 and 
the control signal for the write switch W1 A of FIGURE 5 
go high. Thus, the signal from the first pixel 103a of the 
first row is read out onto signal line SIG1, and is also 
stored in capacitor C1A of delay line 211. In the next 
time increment during period 1, column select signal Y2 
and the control signal for write switch W1 B of FIGURE 5 
go high. This causes the signal from the second pixel 
1 03e of the first row to be read out onto signal line SIG1 , 
and also be stored on capacitor C1 B of FIGURE 5. This 
process continues for the remaining pixels of the first 
row, such that the signals from pixels 1031, 103m, 103q, 
and 103u are read out onto signal line SIG1 and are 
also stored in the capacitors C1C, C1D, C1E, and C1F 
of the delay line 211. While the switches R1A to R1F. 
and W3A, W4A, R3A, and R4A are also shown as tran- 
sitioning during time period 1 , they do not contribute to 
the pixel signals shown on the signal lines SIG1 and 
SIG2 until time period 2. 

[0050] During time period 2, in the first time incre- 
ment the control signals for read switch R1A, write 
switch W3A, and read switch R4A transition high. This 
causes the pixel signal from the first pixel 103a of the 
first row that was previously stored in capacitor CIA of 
delay line 21 1 to be transfierred and stored in capacitor 
C3A of single pixel delay circuit 230. During the next 
time increment, the column select signal Y1 and the 
control signal for the write switch W1A transition high. 
This causes the signal from the first pixel 103b of the 
second row to be read out on signal line SIG1 , and also 
to be stored in the capacitor C1A of the delay line 211. 
It should be noted, that the storing of the signal from the 
first pixel 103b from the second row during this time 
increment is what necessitated the removal of the signal 
from the first pixel 103a of the first row from the capaci- 



tor CIA in the previous increment during time period 2. 
In other words, the signal from the pixel of the first row 
pixel 103a needed to be cleared out before the signal 
from the pixel 1 03b of the second row could be stored in 

5 the capacitor CIA, 

[0051] Similariy, during this same increment, the 
second pixel 103e from the first row needs to be cleared 
out from the capacitor C1B so that the signal from the 
second pixel 103f of the second row could be stored in 

10 the capacitor C1B in the following increment. This is 
accomplished by the control signal for the read switch 
RIB going high at the same time as the write switch 
W4A. so that the pixel signal from the second pixel 103e 
of the first row is transfen-ed from the capacitor C1B to 

15 the capacitor C4A. At the same time, the control signal 
for the read switch R3A transitions high, thus reading 
out the pixel signal from the first pixel 103 a of the first 
row that was previously stored on the capacitor C3A 
onto the signal line SIG2. In this manner, the signal from 

20 the first pixel 103a of the first row is read out on the sig- 
nal line SIG2 at the same time that the signal from the 
first pixel 103b of the second row is read out onto the 
signal line SIGI. In this manner, the signals of pixels in 
adjacent rows are read out simultaneously, as is the 

25 goal of the system. 

[0052] This process continues during time period 2, 
during which the signals from the remaining pixels 
103e, 1031. 103m, 103q. and 103u of the first row are 
transferred from their previously stored locations on 

30 capacitors CIS, C1C, C1D. C1E, and GIF of delay line 
211, to either capacitors C4A or C3A of single pixel 
delay circuit 230. Then, each signal is transfen-ed out of 
single pixel delay circuit 230 onto signal line SIG2. As 
described above, the signals must be transferred off the 

35 capacitor CI B, CI C, CI D, CI E, and C1 F before the sig- 
nals from the remaining pixels 103f 103j, 103n, 103r. 
and 103v of the second row are stored thereon. 
[0053] Thus, the single pixel delay circuit 230 
serves as a temporary storage for the pixel signals, to 

40 hold them for a single time increment between which 
the pixel signals from the first row are removed from the 
delay line 211. following which they are read out onto 
the signal line SIG2 at the same time that the signals 
from the pixels of the second row are both being stored 

45 on the capacitors of the delay line 21 1 and being read 
out on the signal line SIG1. In this manner, the signals 
from the pixels 103b, 103f 103j, 103n, 103r, 103v are 
read out on signal tine S1G1 at the same time as the cor- 
responding adjacent pixels 103a, 103e, 103i, 103m, 

50 103q. and 103u of the first row are read out on signal 
line SIG2. In this manner, the signals from the pixels of 
the first row are read out simultaneously with adjacent 
pixels of the second row, as is the goal of the system. A 
similar process occurs during time periods 3 and 4. with 

55 a simultaneous reading out of adjacent pixels in rows 2 
and 3. and then rows 3 and 4, respectively. 
[0054] While the preferred embodiment of the 
invention has been illustrated and described, it will be 
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appreciated that various changes can be made therein 
without departing from the spirit and scope of the inven- 
tion. For example, while the invention has been 
described as it would operate for simultaneously read- 
ing out pixel signals from pixels in adjacent rows, the 
invention could simifariy operate for simultaneously 
reading out pixel signals from pixels in every other row. 
Such an operation could occur for even field and odd 
field type reading operations, as described in co-pend- 
ing application serial No. 09/110.879, entitled "Single- 
Chip Color CMOS Image Sensor With Two or More Line 
Reading Structure and High-Sensitivity Interiaced Color 
Structure", filed July 7, 1 998, which is hereby incorpo- 
rated by reference. Similarly, the pixel signals from 
every other pixel in a given row could be coupled to a 
common signal line, rather than having every pixel in a 
given row being coupled to a common signal line. Thus, 
the invention should not be limited to the preferred 
embodiment described herein, but should be limited 
only by the claims below. 
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a first set of read switches for selectively 
reading out the pixel signals from the first 
set of storage capacitors onto the output 
line. 

5 

2. The reading structure of Claim 1. further compris- 
ing: 

a second delay line coupled to the first com- 
10 mon signal line for receiving and storing the 

pixel signals; 

first and second primary write switches for 
coupling the inputs of the first and second 
15 delay lines, respectively, to the first com- 

mon signal iine; and 

first and second primary read switches for 
coupling the outputs of the first and second 
delays lines, respectively, to the second 
20 common signal line. 



Claims 

The embodiments of the invention in which an 
exclusive property or privilege is claimed are defined as 
follows: 

1. A reading structure including an analog delay line 
for a MOS image sensor having a pixel array 
formed from a plurality of individual pixels organ- 
ized as rows and columns, the reading structure 
comprising: 

a first common signal line coupled to a plurality 
of columns of the pixel array for receiving pixel 
signals from selected pixels in the columns; 
and 

a first delay line coupled to the first common 
signal line for receiving and storing the pixel 
signals, the first delay line comprising: 



3. The reading structure of Claim 1 , further compris- 
ing a pixel delay circuit coupled between the output 
of the first delay line and the second common signal 
25 line, the pixel delay circuit comprising: 

a second set of storage capacitors for alternat- 
ingly storing pixel signals that are output from 
the first delay line; 

30 a second set of write switches coupled to the 

output of the first delay line, the second set of 
write switches alternatingly operating to write 
pixel signals that are output from the first delay 
line onto each of the capacitors of the second 

35 set of storage capacitors; and 

a second set of read switches coupled to the 
second common signal line for alternatingly 
reading out the pixel signals from the second 
set of storage capacitors onto the second com- 

40 mon signal line. 



an input line coupled to the first common 4. 
signal iine; 

an output line coupled to a second com- 
mon signal line; 45 
a first set of write switches coupled to the 
input line, the first set of write switches 5. 
being coupled In parallel and having at 
least one switch for each of the columns 
coupled to said first common signal line; 50 
a first set of storage capacitors, the first set 
of storage capacitors having at least one 
capacitor associated with each of said 
write switches, the write switches operat- 6. 
ing in sequence so as to write one of each 55 
of the pixel signals from a row of pixels in 
sequence into one each of said capacitors 
of said first set of storage capacitors; and 



The reading structure of Claim 1 , wherein the first 
delay line further comprises a buffer coupled 
between the first common signal line and the input 
line. 

The reading structure of Claim 1 , wherein the first 
delay line further comprises a first set of read buff- 
ers, each read buffer being coupled between one of 
the storage capacitors of the first set of storage 
capacitors and one of the read switches of the first 
set of read switches. 

The reading structure of Claim 1 , wherein the first 
delay line further comprises a charge amplifier cou- 
pled between the output of the delay line and the 
second common signal line. 
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7. A method for simultaneously processing analog 
signals from two rows of a MOS image sensor hav- 
ing a pixel array of a plurality of individual pixels 
organized as a plurality of rows and columns, said 
method comprising the steps of. 



are stored are the same memory cells on which the 
analog pixel signals from the second row are 
stored, and wherein after the pixel signals are read 
out from the memory cells, they are temporarily 
stored in a pixel delay circuit. 



(a) reading out from the pixel array and trans- 
fening the analog pixel signal from each indi- 
vidual pixel of a plurality of selected pixels in a 
first row of the pixel an^y over a first common io 
signal line to a reading structure having at least 
one individual memory cell for each of the 
selected pixels of the first row, the memory 
cells being external to the pixels, and further 
storing the analog pixel signals on the memory is 
cells; 

(b) reading out from the pixel array and trans- 
ferring the analog pixel signal from each indi- 
vidual pixel of a plurality of selected pixels in a 
second row of the pixel array over the first com- 20 
mon signal line to the reading structure having 

at least one individual memory cell for each the 
selected pixels of the second row, the memory 
cells being external to the pixels, and further 
storing the analog pixel signals on the memory 2S 
cells; and 

(c) at the same time that the analog pixel sig- 
nals from the plurality of selected pixels in the 
second row are being read out from the pixel 
array and stored on the memory cells, reading 30 
out from the reading structure the analog pixel 
signals from the selected pixels of the first row 
that were previously stored on the memory 
cells. 

35 

8. The method of Claim 7, wherein the memory cells 
that store the analog pixel signals from the selected 
pixels of the first row comprise a first set of memory 
cells, and the memory cells that store the analog 
pixel signals from the selected pixels of the second 40 
row comprise a second set of memory cells. 

9. The method of Claim 8, wherein the first and sec- 
ond rows of selected pixels are adjacent to one 
another, and the analog pixel signals from substan- 45 
tially adjacent pixels in the two rows are read out at 
the same time. 



12. The method of Claim 11, wherein the analog pixel 
signals from the second row of pixels are read out 
from the pixel array at the same time that the analog 
pixel signals from the first row of pbcels are read out 
from the pixel delay circuit. 

13. The method of Claim 12, wherein the first and sec- 
ond rows of pixels are adjacent to one another, and 
wherein the analog pixel signals from substantially 
adjacent pixels in the two rows are read out at the 
same time. 



10. The method of Claim 8, wherein the pixel array fur- 
ther comprises a third row of selected pixels, and 50 
wherein after the analog pixel signals from the first 
row of selected pixels have been read out from the 
first set of memory cells, the analog pixel signals 
from the third row of selected pixels are stored on 

the first set of memory cells. 55 

11. The method of Claim 7, wherein the memory cells 
on which the analog pixel signals from the first row 
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